Assessment of the clinical and analytical performance of the Aptima SARS-CoV-2 assay using the VALCOR protocol.

BACKGROUND: The COVID-19 pandemic highlighted the importance of diagnostic testing against curbing the spread of SARS-CoV-2. The urgent need and scale for diagnostic tools resulted in manufacturers of SARS-CoV-2 assays receiving emergency authorization that lacked robust analytical or clinical evaluation. As it is highly likely that testing for SARS-CoV-2 will continue to play a central role in public health, the performance characteristics of assays should be evaluated to ensure reliable diagnostic outcomes are achieved. METHODS: VALCOR or "VALidation of SARS-CORona Virus-2 assays" is a study protocol designed to set up a framework for test validation of SARS-CoV-2 virus assays. Using clinical samples collated from VALCOR, the performance of Aptima SARS-CoV-2 assay was assessed against a standard comparator assay. Diagnostic test parameters such as sensitivity, specificity and overall per cent agreement were calculated for the clinical performance of Aptima SARS-CoV-2 assay. RESULTS: A total of 180 clinical samples were tested with an addition of 40 diluted clinical specimens to determine the limit of detection. When compared to the standard comparator assay Aptima had a sensitivity of 100.0% [95% CI 95.9-100.0] and specificity of 96.7% [95% CI 90.8-99.3]. The overall percent agreement was 98.3% with an excellent Cohen's coefficient of κ = 0.967 [95% CI 0.929-1.000]. For the limit of detection, Aptima was able to detect all of the diluted clinical samples. CONCLUSION: In conclusion. validation of Aptima SARS-CoV-2 assay using clinical samples collated through the VALCOR protocol showed excellent test performance. Additionally, Aptima demonstrated high analytical sensitivity by detecting all diluted clinical samples corresponding to a low limit of detection.

Nationwide Harmonization Effort for Semi-Quantitative Reporting of SARS-CoV-2 PCR Test Results in Belgium.

From early 2020, a high demand for SARS-CoV-2 tests was driven by several testing indications, including asymptomatic cases, resulting in the massive roll-out of PCR assays to combat the pandemic. Considering the dynamic of viral shedding during the course of infection, the demand to report cycle threshold (Ct) values rapidly emerged. As Ct values can be affected by a number of factors, we considered that harmonization of semi-quantitative PCR results across laboratories would avoid potential divergent interpretations, particularly in the absence of clinical or serological information. A proposal to harmonize reporting of test results was drafted by the National Reference Centre (NRC) UZ/KU Leuven, distinguishing four categories of positivity based on RNA copies/mL. Pre-quantified control material was shipped to 124 laboratories with instructions to setup a standard curve to define thresholds per assay. For each assay, the mean Ct value and corresponding standard deviation was calculated per target gene, for the three concentrations (107, 105 and 103 copies/mL) that determine the classification. The results of 17 assays are summarized. This harmonization effort allowed to ensure that all Belgian laboratories would report positive PCR results in the same semi-quantitative manner to clinicians and to the national database which feeds contact tracing interventions.

VALCOR: a protocol for the validation of SARS-corona virus-2 assays.

BACKGROUND: Testing for SARS-CoV-2, together with vaccination, is one of the most vital strategies in curbing the current COVID-19 pandemic. The pandemic has led to an unprecedented need for diagnostic testing and the rapid emergence of an abundance of commercial assays on the market. Due to the nature of the pandemic and in the interest of health protection, many of these assays received provisional authorisation for emergency use without thorough validation. To limit false negative and false positive results, it is key to define common criteria that SARS-CoV-2 assays need to fulfil. VALCOR or "VALidation of SARS-CORona Virus-2 assays" is a protocol designed to set up a framework for test validation of SARS-CoV-2 virus assays. OBJECTIVES: VALCOR is a study protocol for the validation of assays used for confirmation of the presence of SARS-CoV-2 in patients with COVID-19 disease or the screening of carriers of SARS-CoV-2 virus by the identification of viral RNA in oropharyngeal and/or nasopharyngeal specimens or other specimens from the human respiratory tract. METHODS: The VALCOR panel of samples will contain clinical human specimens and standardised artificial specimens. The collection of clinical specimens will include nasopharyngeal or oropharyngeal specimens or other specimens from the respiratory tract obtained from COVID-19 patients and healthy carriers of SARS-CoV-2 as well as specimens from subjects not carrying SARS-CoV-2. Artificial specimens include calibrated amounts of viral RNA of SARS-CoV-2 sequences provided by established competent agencies that produce reference materials for the assessment of the limit of detection of each assay. The panel of samples are sent from a central reference laboratory (having access to biobanks of clinical specimens tested already for SARS-CoV-2 with a reference comparator assay) to participating laboratories for testing with a SARS-CoV-2 index assay that requires evaluation. DISCUSSION: VALCOR provides a harmonised and standard framework to benchmark the testing performance of SARS-CoV-2 assays that are rapidly evolving. As the pandemic incited an urgent need for testing capacity, there is a gap in the comprehensive validation of SARS-CoV-2 assays. This study will generate comprehensive validation data for assays used for the diagnosis of SARS-CoV-2 and may serve as a basis for other validation protocols.